#low-latency inference04/11/2025
Cache-to-Cache (C2C): LLMs Communicate Directly Through KV-Cache Fusion
'Cache-to-Cache (C2C) lets LLMs exchange semantic information via KV-Cache fusion, boosting accuracy by about 3–10% over text-based pipelines and roughly halving latency.'